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(54) STEREOSCOPIC IMAGE RECORDING/REPRODUCING SYSTEM 

(57)Abstract: 

PURPOSE- To make it possible to reproduce a 
three-dimensional image without depending 
upon a binocular parallax method by dividing 
an original image in each hierarchy in the depth 
direction, rerecording the divided images and 
successively reproducing the rerecorded 
contents as real images having respectively 
different space forming positions. 
CONSTITUTION: The distance of an object is 
extracted from the outlines or the like of 
geometric elements of the object included in a 
reference frame to find out the depth of the 
object and the object is divided in the picture 
depth direction based upon the found depth to 
find out the number of divided planes. The divided object is projected to the nearest 
divided plane to obtain a projection image projected to the divided plane and the 
projection image is recorded in an image recording medium 11 together with depth 
position information expressing the position of the divided plane in the picture depth 
direction by an identical distance image extracting/recording means 9. Thus the object 
in the image is stereoscopically expressed from the plane image. Consequently an 
already recorded planar image can be converted into a stereoscopic image without using 
a specific stereoscopic photographing device, the stereoscophic image can be rerecorded 
and reproduced and the stereoscopic image having optional screen size can be provided. 
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CLAIMS 



[ClaimCs)] 

[Claim l] A geometric element is extracted from flat-surface image information 
including at least one photographic subject arranged in three -dimensions space. The 
depth information showing the distance of said geometrical element is extracted from 
said flat-surface image information. The photographic subject corresponding to a 
geometric element and said geometric element extracted with reference to the database 
with which the relation of a photographic subject is recorded is presumed beforehand. 
The soHd configuration of each photographic subject presumed firom the database with 
which the soUd configuration of a photographic subject is recorded beforehand is read. 
Arrange to virtual three-dimensions space and the physical relationship in the depth 
direction between each photographic subject is presumed based on said depth 
information. Ask for an additional frame number based on said physical relationship, 
and the soUd configuration divided by only an additional frame number dividing the 
sohd configuration arranged in said virtual three-dimensions space according to a field 
perpendicular to the depth direction is acquired. The solid image recording approach 
characterized by recording both the depth information groups showing the location in 
said depth direction of the flat-surface image group which projected each divided solid 
configuration on the field which divided the near soUd configuration, respectively, and 
was obtained, and each of this divided solid configuration on a record medium. 
[Claim 2] The additional frame for forming a solid image from one basic frame of the 
picture signal of basic frame spacing is formed. It is sohd image recording equipment 
which inserts this in said basic inter-frame one, and forms and records a solid picture 
signal. A means to extract the distance of the geometric element of the photographic 
subject included in said basic frame, to ask for the depth of a photographic subject, and 
to ask for the number of the division flat surfaces which divide said photographic 
subject in the screen depth direction based on this depth, Sohd image recording 
equipment equipped with same depth map extract record means to record on an image 
recording medium with the depth positional information which acquires the projection 
image which projected the divided photographic subject on the near division flat surface, 
and was projected on this division flat surface, and expresses a location [ in /, for this / 
said screen depth direction of this division flat surface ]. 

[Claim 3] An image recording medium performance means to perform the image 
recording medium by which the depth position signal showing the picture signal which 



bears a 2-diinensional image, and the location where said 2-dimensional image should 
be projected was recorded, and to restore to said picture signal and said depth position 
signal, Solid picture reproducer equipped with the projection lens control means which 
answers supply of said depth position signal, drives an image projection lens in the 
direction of an optical axis, and controls an image formation location, and the image 
delivery system which changes said picture signal into a 2-dimensional image, and 
projects this via said image projection lens. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Apphcation] This invention relates to the image transformation which 
changes 2-dimensional images, such as an image captured by image photography 
eqmpments, such as a television camera, and an image reproduced from the image 
recording medium, into the image source of the solid image device which projects a sohd 
image. 
[0002] 

[Description of the Prior Art] Conventionally, the attempt which offers the image 
accompanied by a feeling of depth and the so-called solid image is performed variously. 
Although various technique is proposed by the approach of forming a solid image, many 
methods of using the so-called binocular parallax from application to a dynamic image 
or the ease of work are used. An observer is made to produce a cubic effect by this 
method's photoing one candidate for photography from two directions equivalent to 
people's both eyes, and showing the eye to which an observer corresponds by the 
suitable approach each image. 

[0003] By this binocular parallax method, since the image from a 2-way is needed, two 
photography equipments are prepared in the case of photography, and two photography 
images are photoed and recorded on coincidence from two directions corresponding to 
both eyes. Therefore, depending on the installation conditions of the photography 
equipment in the case of photography, the observation conditions of human being who 
observes the reproduced image also need to set the recorded image by this photography 
condition. For example, if the image photoed on the assumption that it provided as a 
small screen is projected on a big screen, when the distance of an observer and a screen 
seldom differs from photography conditions, there is fault which two images for 
right-and-left eyes estrange too much relatively, and do not turn into a stereoscopic 



model, but is observed by the twin image. On the contrary, if the image photoed on the 
assumption that it provided as a big screen is observed on a small screen, when the 
distance of an observer and a screen seldom dififers from photography conditions, 
parallax is hardly recognized but there is fault which a cubic effect does not produce. 
[0004] Such fault is common to the solid image observation method which needs not 
only the thing of a binocular parallax method but two or more parallax. 
[0005] 

[Problem(s) to be Solved by the Invention] As mentioned above, in the picture 
reproducer for the conventional stereoscopic vision, two or more superficial images 
photoed with the photography equipment only for solid images are recorded separately, 
and if it requires reproducing on the same conditions as the conditions set up on the 
occasion of photography of each image on the occasion of playback and the magnitude of 
the screen of image reconstruction changes, as a result of not reproducing an image 
with suitable parallax, a cubic effect is fully hard to be acquired. Moreover, the 
photography equipment only for stereograms is not the general sense in respect of the 
difficulty of a monitor configuration, the magnitude of equipment, etc. 
[0006] Therefore, this invention forms a stereoscopic vision image firom the image 
information recorded as a flat-surface image, and it aims at offering the solid image 
transformation approach and solid image transformation equipment which made it 
possible, without [ of reproducing a three-dimension image ] being based on a binocular 
parallax method. 
[0007] 

[Means for Solving the Problem] The solid image recording equipment which constitutes 
the soUd image recording regeneration system of this invention in order to attain the 
above-mentioned purpose In the solid image recording equipment which forms the 
additional frame for forming a solid image firom one basic firame of the picture signal of 
basic frame spacing, inserts this in said basic inter- firame one, forms a solid picture 
signal, and records this A means to extract the distance of a photographic subject from 
the profile of the geometric element of the photographic subject included in the 
above-mentioned basic firame etc., to ask for the depth of a photographic subject, and to 
ask for the number of division flat surfaces which divides the above-mentioned 
photographic subject in the screen depth direction based on this depth. It is 
characterized by acquiring the projection image which projected the divided 
photographic subject on the near division flat surface, and was projected on the division 
flat surface, and having same depth map extract record means to record on an image 
recording medium with the depth positional information showing a location [ in / for this 



/ the above-mentioned screen depth direction of this division flat surface ]. 
[0008] Moreover, the solid picture reproducer which constitutes the solid image 
recording regeneration system of this invention An image recording medium 
performance means to perform the image recording medium by which the depth 
position signal showing the picture signal which bears a 2-dimensional image, and the 
location where the above-mentioned 2-dimensional image should be projected was 
recorded, and to restore to the above-mentioned picture signal and the above-mentioned 
depth position signal. It is characterized by having the projection lens control means 
which answers supply of the above-mentioned depth position signal, drives an image 
projection lens in the direction of an optical axis, and controls an image formation 
location, and the image delivery system which changes the above-mentioned picture 
signal into a 2-dimehsional image, and projects this via the above-mentioned image 
projection lens. 
[0009] 

[Function] Solid image recording equipment extracts a geometric element from a 
flat-surface image, and presumes the depth of a photographic subject. A photographic 
subject is distinguished from the geometric element extracted from the screen according 
to pattern recognition, the data of the solid configuration of a photographic subject are 
read in the database of the configuration of various photographic subjects, and such 
presumption can presume the depth of a photographic subject fix)m configuration data. 
When there are two or more photographic subjects, it is possible to presume the 
distance relation of the depth direction of a superficial photographic subject in 
consideration of the physical relationship between photographic subjects. It asks for the 
number of the parting planes which divide a photographic subject in respect of being 
perpendicular to the depth direction based on the depth of the presumed screen, a 
parting plane is arranged in the predetermined distance of the depth direction of a 
screen, and a photographic subject is divided. By using the image which projected the 
divided photographic subject on the parting plane, and was projected on the parting 
plane as an additional frame, with the location in the depth direction of a parting plane, 
it inserts in the basic inter -frame one of a subject* copy image, and records on an image 
medium. Solid picture reproducer projects a series of image frames at high speed, 
setting up the projection location of a playback image for every frame. 
[00 10] Consequently, it becomes possible to observe the superficial image information 
[ finishing / record ] which is not what was photoed for stereoscopic vision as a 
stereoscopic model. Moreover, even if the difference among observation conditions, hke 
the screen size in the case of playback differs from the distance of a screen and an 



observer arises, the image which was photoed for stereoscopic vision and recorded on it 
can also be corrected with above-mentioned equipment in the case of image recording, 
and may be recorded or reproduced as a proper stereoscopic vision image. 
[0011] 

[Example] The principle of the stereoscopic vision concerning the stereoscopic vision 
equipment of this invention is explained with reference to drawing 5 R> 5. Drawing 5 
(A) shows the condition that the cubes A and B of two photographic subject slack are 
recorded as a £lat-sur&ce image. The procedxxre which forms these cubes A and B as a 
stereoscopic model is explained. 

[0012] First, it distinguishes what the graphic form which extracted the geometric 
figure which forms the image from the flat- surface image, and was extracted using 
technique, such as pattern recognition, is. For this reason, the model of the class of 
photographic subject which investigates the contents of the flat- surface image source 
beforehand, and appears in a screen, and its solid configuration is accumulated, and the 
data base is built. A photographic subject is distinguished from the extracted graphic 
form, and the model of a solid configuration is chosen. This sohd model is arranged to 
the virtual three -dimensions space formed in the computer shown in drawing 5 (B). 
Arrangement can be set up using perspective etc. firom the profile of a geometric figure. 
The cubical solid-state elements A and B are arranged in the model of the unit 
registered into a database in a solid-state element, then a virtual space. If the late rice 
firont of a screen is made to correspond to X shaft orientations of a virtual space, the 
soUd-state element A and the depth between B will become clear with the data showing 
the configuration of a solid model. For example, the greatest xmax among P points (x y, 
z) which form the fi:ont face of each model The minimum xmin The depth distance of a 
model group is found firom a difference. According to this depth, a Y-Z flat surface 
divides a solid-state element. If depth is large, the number of partitions will be 
increased. At drawing 5 (B), it is 11 -13. Three flat surfaces are dividing. This number of 
partitions is related to the resolution of the stereoscopic model reproduced behind. And 
it asks for the part into which a solid-state element projects fi'om the divided flat 
surface. SI of drawing 5 (C) Flat surface 11 from the part of the solid-state element 
projected to the method of this side is shown. S2 Flat surface 11 12 The solid-state 
element which exists in between is shown. S3 Flat surface 12 13 The solid-state element 
which exists in between is shown. 84 Flat surface 13 The solid-state element which 
exists between flat-surface linfinity used as a background which is not illustrated is 
shown. Thus, flat-surface 11 -13 The divided solid-state element 81 - 84 It projects on a 
flat surface 11 - linfinity firom a transverse plane, respectively, and the additional frames 



F11-F14 are obtained. Namely, the divided solid-state element Si ■ S4 By displa3dng the 
pixel of the &ont face which is visible &om transverse planes other than a cutting plane 
of YZ component, respectively, the additional frames F11*F14 are obtained. In addition 
to image information, frame positional information xl ' showing the frame location 
which should be projected - x4 ' are added to these additional frames F11-F14. The solid 
screen information of one frame which adds the background frame FlO except the 
solid-state elements A and B and positional information x infinity to the frame which 
should form stereoscopic models, such as this, from the basic frame FlO, and consists of 
frames F10-F14 and FlOinl&nity is formed, such an image processing -- the subject copy 
image of drawing 6 (B) - each a series of solid picture signals which wind about frame 
f7 -fl2 and are shown in ****** and drawing 6 (A) are acquired. This has composition 
inserted by the number according to the solid resolution which needs the additional 
frame shown by the dotted line for forming a stereoscopic model in each inter-frame one 
of the subject- copy picture signal shown as a continuous line. 

[0013] The positional information which expresses with the video signal showing each 
frame the time code which shows the projection passage of time from the address slack 
frame number of a frame and an initial frame, and the location which should project a 
frame corresponding to the depth of a photographic subject is inserted in inter-frame. 
[0014] This solid picture signal is recorded on image recording media, such as a 
videodisk and a video tape. 

[0015] In the solid picture reproducer which is not illustrated, a series of images which 
set up the location which should restore to the positional information recorded for every 
frame, and should project each frame by the movable projection lens of a projector or the 
mirror for optical-path* length change, and restore to a video signal, project the image of 
each frame by the projector, and move to the late rice front of a screen are formed. If an 
observer looks at a series of images from which this projection location changes to the 
late rice front of a screen at high speed, a series of flat-surface images will be recognized 
as a stereoscopic model according to the visual after-image effectiveness. 
[0016] The example of this invention is explained with reference to drawing 1 and 
drawing 2 . Drawing 1 shows the configuration of the stereogram conversion system of 
this invention, and drawing 2 shows the configuration of a solid image reconstruction 
system. 

[0017] The subject-copy image is recorded on the image recording media 1, such as a 
videodisk, a video tape, CD-ROIVI, and a hard disk. This image recording medium 1 is 
performed with the picture reproducers 2, such as a videodisk player and digital VTR, 
and the frame number according to the capacity of a latter image memory, for example. 



one frame, is reproduced. Each reproduced frame is changed into the digital value 
which bears the lightness of each pixel, and the color information on a hue, and is 
memorized in an image memory 4. For example, 256 colors can be expressed if 1 pixel is 
displayed by 8 bits. Moreover, the video signal acquired from the photography 
equipments 3, such as a television camera, can be changed into digital value, and a 
predetermined frame can be memorized to an image memory 4. 

[0018] An image memory 4 gives the image for one frame to depth presumption 
equipment 5. Depth presumption equipment 5 is the computer constituted suitable for 
image data processing, and forms the three-dimensions virtual space mentioned above 
in the memory which is not illustrated. And fiinctions, such as individual location 
presumption section 5c which presumes image recognition section 5a which 
discriminates what this is from the geometric characteristic value of the photographic 
subject currently formed in the image memory 4, whole location presumption section 5b 
which presumes the identified context between photographic subjects, and the overall 
physical relationship between [ each ] photographic subjects, are borne. Moreover, it is 
possible to also make the function of the same below mentioned depth map extract 
recording device 9 of an image extract bear. Presumption of this etc. is performed 
referring to serially the data stored in the database equipment 6 which registered the 
master data the general size of a photographic subject, and geometrical-related. 
[0019] Even if it uses the database with which the configuration of a photographic 
subject etc. was registered beforehand, when the goodness of fit showing the precision of 
photographic subject distinction is low and presumption is difiEicult, the data correction 
equipment 8 which made it possible to carry out correction processing of the data 
suitably by the manual actuation by the operator is used. The interface with an operator 
is performed by the data entry terminal 10 equipped with information-display machines, 
such as a keyboard and an image, etc. The corrected data are registered as new data 
into the above-mentioned database through database correction equipment 8. Moreover, 
the new data obtained from the above-mentioned presumed result are registered as new 
data into said database by the renewal equipment 7 of data. 

[0020] The presumed result by depth location presumption equipment 5 is sent to the 
same depth map extract recording device 9, and correction addition of the subject-copy 
image set by the below -mentioned class and below-mentioned property of picture 
reproducer 13 is performed. The same depth map extract recording device 9 is a suitable 
computer for the image processing equipped with image recording equipment, it 
extracts the part of the same distance, or the part which belongs in predetermined 
range in the depth direction in the depth direction of the screen which changed the 



subject-copy side into the three-dimensions screen, forms one screen from a subject-copy 
side, and records this on the image recording medium 11. A video signal [ **** ] is 
formed by forming two or more additional frames from one frame of a subject-copy 
image, and repeating recording serially the frame used as a background, and an 
additional frame group on the image recording medium 11. 

[0021] In addition, when picture reproducer 13 serves as the stereoscopic vision 
equipment of a binocular parallax method, correction is added and recorded as 
becoming a proper value according to distance with the screen size and observer who 
show about a stereoscopic model in the parallax and a mutual distance of the image for 
right-and-left both eyes. 

[0022] Next, actuation of depth location presumption equipment 5 is explained with 
reference to the flow chart shown in drawing 3 . As mentioned above, the principal part 
of depth location presumption equipment 5 is constituted by the computer (it is 
hereafter called CPU for short), and can also perform control of related equipment. If 
equipment starts an image processing in order to obtain a solid image from a 
flat-surface image, CPU will make an image memory 4 memorize image information 
from the image recording medium regenerative apparatus 2 which performs the image 
recording medium 1 used as a subject-copy image, or photography equipment 3 (step 
S103), and will perform the following processings. 

[0023] First, the process which carries out the shape recognition of the photographic 
subject reflected in the screen (steps S104-S113), The process which extracts the graphic 
form of the settled form which detects the profile of a photographic subject and exists as 
a graphic element (steps S104-S106), The process which presumes the integrated state 
of two or more extracted graphic elements as a solid-state element which investigated 
and became independent (steps S107-S108), In automatic distinction, the process (steps 
S112-S113) which registers into a database the process (steps S109-S110) at which 
human being checks a part with a low goodness of fit, the process (step Sill) which 
names the above-mentioned solid-state element which the check ended, this, etc. is 
performed. Any process consists of supplementary actuation of performing processing 
for determining this etc., when a judgment is negation, the process in which the 
completion situation of above-mentioned actuation is judged, and. 

[0024] extracting the field collected according to lightness distribution and tone 
distribution of an image as an example in a profile extract process (S104) **** change 
of this etc. to an edge — emphasizing (step S105) " a graphic form configuration 
fimdamental after that and a interpolation curve a profile - ****** (step S106) " 
well-known technique [ like ] is taken. 



[0025] An integrated state is what (step S108) geometry and an actual body appear and 
the inclusion relation of each graphic element determined in (S107) and the preceding 
paragraph is presumed for from the direction, and the solid-state element with which 
inclusion of the graphic elements, such as this, is carried out is determined. As for the 
part which is low and cannot determine a presumed goodness of fit, (step S109) and an 
operator can perform correction correction ****** through database correction 
equipment 8 from a data input station 10 (step SI 10). When an operator performs 
naming of a graphic element and label attachment, (Sill) above-mentioned data input 
station 10 grade is used (SllO). if all are determined - database equipment 6 - 
registering (S112) " the data -base -updating activity at this time (step S113) is done by 
the renewal equipment 7 of data. The actuation by operators, such as this, is equivalent 
to the complement of the function of image recognition section 5a indicated to Fig. 1, or 
a kind of study of image recognition section 5a. 

[0026] Then, CPU performs the process (steps 812 1*8 130) which determines the order 
location in the screen of the above-mentioned solid-state element. This is a part of 
function which whole location presumption section 5b bears. It consists of processing in 
case the processing and the judgment which also judge these processes are negation. 
That is, it has the presumed process (step S125) based on the optical conditions at the 
time of photography, such as a distinction process (step S123) in relation by ambient 
light, such as a distinction process (step Sl2l), shading and lightness of a context from 
the graphic-element configuration itself, and a hue, and a focus, a dotage degree at the 
time of photography, the check process (step S127) by the operator, and the registration 
process (step S129) to a database. In each process, such as this, when the goodness of fit 
of a decision result is low, supplementary actuation is performed. 

[0027] First, in the order decision (S121) from a configuration, geometric knowledge, 
such as a lap of a geometric figure and a continuity, is pulled out from database 
equipment 6, and presximed actuation is performed as contrasted with a subject-copy 
image (step 8122). In an environmental condition (S123), the knowledge database (step 
8124) about the knee condition of reflection of light, or a dispersion condition and a 
shadow is used. It is also useful if there is a database (step 8126) about extent of 
focusing of the lens at the time of photography and the relative relation of the depth 
direction of a screen. When the update operation of the check by the operator or a 
database is required (step 8127), the same process as the contents described previously 
is taken (steps S128 and S130). 

[0028] next, the alienation by the process (steps 8131-8141) which quantifies the 
context of each sohd-state element for which it asked by the above-mentioned 



processing, the extract process (step S132) of the graphic form used as a gage, the 
extract process (step S134) of the vanishing point of perspective, light, the shadow, or 
the color - check / registration processes (steps S138 and S140), such as a derivation 
process (step S136) of extent and this, are performed. Steps S131-S141 are a part of 
other functions which whole location presumption equipment 5b bears. 
[0029] when the quantification activity is already completed (Sl3l), pass the incidental 
activity (steps S139 and S141) of this same with having carried out a registration [ a 
check and ] activity and point ** etc. — it shifts to the next phase. If the dimension 
extract of (Sl3l) and a solid-state element is omitted when that is not right (S132), it 
will look for the solid-state elements (a crest, an indicator, a building, a man, industrial 
product, etc.) which compare the solid-state element and knowledge database which 
have already been registered, and serve as a gage (step S133). next, the extract of a 
vanishing point is performed **** (S134) - the stroke of the already registered body " 
it asks for a vanishing point fi-om the deformation condition within a field, the 
geometric description is compared with the configuration of a solid-state element, and 
the distance relation between each solid-state element is presumed based on 
perspective (step S135). Moreover, if the quantification by shading etc. is not performed 
(SI 36), the thing of the elongation condition of a shadow or a color for which it fades and 
quantification is attained firom attenuation of condition or the quantity of light is also 
possible (step S137). In the above process, when the goodness of fit of a presumed result 
is low (8138), an operator may perform correction and the new entry of data of data 
through the above-mentioned data entry terminal 10 or database correction equipment 
8 (S139). 

[0030] Next, the process (steps S151-S159) which quantifies the context of the graphic 
element contained in each sohd-state element is performed. For example, the height of 
human being's nose, flinging-up extent of hand and foot, etc. have a common thing 
about the irregularity of a solid-state element. Decision actuation takes the lead and a 
series of processes of the contents, such as this, are the same as that of the 
quantification process of the context of the solid-state element mentioned above, and 
abbreviation. A difiierent process is an extract process (step S134) of a vanishing point, 
and since it has already asked, it is not necessary to perform it here. This process 
(S151-S159) is equivalent to the function which individual location presumption section 
5c bears. 

[0031] Although the process described until now is explanation about one screen When 
decision is dif&cult only on one screen and the database about the screen of order is 
required (step S161) Furthermore, when other screens are called to an image memory 4 



or other screens are memorized in the image memory 4, the goodness of fit of a 
presumed activity is raised by performing various processings described above about 
other screens (S162), and comparing a result its result and last time (S163). The same 
check / registration activity (steps S164-S167) as the point attaches also to this. 
[0032] the depth of the picture reproducer 13 actually used after ending the above 
process - based on resolution and the depth of a screen, the number of sheets of a depth 
screen (additional frame) and the location of a depth screen are defined (step S171). The 
solid-state element and graphic element which corresponds according to the number of 
sheets and location of this depth screen are re-projected on the depth screen which 
divides a solid-state element and a graphic element like drawing 5 (C), and it records on 
a suitable image recording medium in the refreshable condition with the same depth 
map extract recording device 9 (step S172). The solid image source which repeated steps 
S103-S172 about each frame of a subject-copy image, and was changed into the image 
recording medium 11 from the flat-surface image source for solid image projection is 
obtained. Performance information, such as depth information, a frame number, and a 
time code, is inserted in this solid image source to the inter-frame fly-back-line period 
field for every frame. 

[0033] And if it is in generation of a solid image, the image recording medium 11 is 
performed with a regenerative apparatus 12, and it restores to depth information with 
the recorded image information, and picture reproducer 13 is supplied by making this 
into a video signal and a projection position control signal. Picture reproducer 13 forms 
a screen by the image information of a video signal, and sets the projection location of a 
screen as the late rice front of image projection space for every frame using the depth 
information on a projection position control signal. When the formation location of each 
screen changes in late rice front at high speed, the image group which remains as 
human being's vision top after-image is compounded, and it seems that a stereoscopic 
model exists to those who observe. 

[0034] in addition, the depth of the depth screen in late rice front *- resolution (screen 
frequency in X shaft orientations) can be made so high that it is close to an observer 
according to a visual property, and the thing of a certain depth distance beyond can use 
it only as the flat-surface image of a background. 

[0035] Drawing 7 shows the example of a configuration of the stereoscopic vision 
equipment using the equipment which observes a stereoscopic model, reproducing the 
image of the same distance continuously among the picture reproducers 13 mentioned 
above. 

[0036] The video signal to which it restored with image recording medium performance 




equipment 12 is sent to image restoration section 13a of picture reproducer 13. Image 
restoration section 13a tunes distortion, pedestal level, etc. of an image which project a 
video signal according to the property of the actually used image reconstruction system 
finely and when adjustment is unnecessary it outputs the same signal as an input 
signal. Among this output signal, a picture signal part is sent to image projection 
equipment 13b, such as Projector CRT, and is changed into an optical image. This 
optical image can set the formation location of a real image 14 as the points 14a and 14b 
of the arbitration of the depth direction by moving lens equipment 13c which moves by 
the motor. 13d of moving lens control sections drives the voice coil motor of moving lens 
equipment 13c based on a projection position control signal. By this, a projection lens 
carries out high-speed migration of the optical-axis top in order, and the location of the 
real image 14 formed in space moves it before and behind the depth direction. In 
addition, when a video signal and a projection position control signal get over as 
composite signals and are supplied, the video signal which bears image information by 
signal separation section 13i, and the projection position control signal which bears lens 
control information are separated. 

[0037] Although the location of the vertical direction of the image of the real image 
materialized to space may be unable to be adjusted neither by image restoration section 
13a nor above-mentioned moving lens section 13c, it can change the formation location 
of an image using two sets of reflecting mirrors 13e and 13g at this time. Reflecting 
mirrors 13e and 13g operate two degrees of freedom per set of a reflecting mirror with 
the reflecting mirror attitude control equipments 13f and 13h, respectively. 
[0038] The projection image from picture reproducer 13 is materiaUzed in accordance 
with the image optical axis 15, and is shown to an observer 16 via a concave mirror 17. 
The gestalt which left the vertical sections 17a and 17b of a concave mirror as shown in 
drawing, the gestalt in which the whole surface of a concave mirror remained, or the 
gestalt which formed the concave surface with many small plane mirrors is also 
available for the above-mentioned concave mirror. If the location of the projection image 
mentioned above sets to 18a and 18b, the reflected image formed with a concave mirror 
will be set to 14a and 14b. 

[0039] In this example, the above-mentioned image optical axis 15 and the optical axis 
19 of a concave mirror may be set up to some extent with the include angle, although set 
up in parallel. At this time, a proper condition resets each part in said picture 
reproducer 13. 

[0040] Drawing 8 is an example in case the image recorded on the above-mentioned 
image memory temporarily is an image for right-and-left eyes for binocular visions. 



actual " the stroke of an image memory ■■ although only the image for the one eye is 
recorded on the region, if the image for both eyes is drawn on coincidence for 
convenience - 21a - like - right and left 11 only - it is shown as a duplex image which 
separated. Since explanation is easy, drawing is explaining the image as a circle. This 
distance 11 Although it is necessary to correspond to human being's interocular distance, 
when the size of a presentation screen becomes large, the size of an image also becomes 
large like 21b, and it is the clearance 12 of the image for right-and'left eyes as a result. 
It increases and stops suiting interocular distance. On the contrary, when a 
presentation screen size becomes small like 21c, it is the clearance 13 of the image for 
right-and-left eyes. It decreases and interocular distance is not suited in this case, either. 
In any case, to observation of a stereoscopic model, possibility of becoming unsuitable 
conditions is large. Then, it responds to the size of a presentation screen and is the 
proper distance 11 about the clearance of the image for right-and-left eyes. The corrected 
image is recorded on the same depth map extract recording device 9. In this case, 
although the thing of the same distance is not extracted if the image recorded is said 
strictly, depth location presumption equipment 5 is used like the above-mentioned 
example. That is, since distortion may be produced in the reproduced solid image only 
by adjusting the clearance of the image for right-and-left eyes, after presuming the solid 
configuration for observation by the above-mentioned image recognition section 5a and 
the above-mentioned location presumption section 5b, the image for right-and-left eyes 
is generated for the image when observing with proper parallax by the above-mentioned 
individual location presumption section 5c. In this generation, search the image of the 
parallax which corresponds from other parts of a subject-copy image, and it uses, or a 
new image is made using a previous presumed result. 

[0041] The contents explained above are examples of the equipment concerning this 
invention, for example, various deformation and application of others which attain 
exchange of the sequence of each processing process and the purpose of a processing 
process, such as installation of well-known technique, are possible for them. 
[0042] 

[Effect of the Invention] As explained above, since the photographic subject in this 
image is solidified from a flat- surface image according to this invention, special 
stereoscopic vision photography equipment is not needed, but the flat- surface image 
already recorded can be changed as an image for stereoscopic vision, and can be 
re-recorded, and it can reproduce. Moreover, it is possible to show a stereoscopic model 
with the free size of a screen, without making an observer wear special glasses etc. for 
stereoscopic vision. Furthermore, it is also possible to apply to the image currently 




recorded on stereoscopic vision. 



(l9)B*H#^)t (JP) (12)<2^^#P^<2^S (A) (ll)#f^mM-^-5l#^ 

#IS¥5-91545 

(43)ii^M0 ¥^5^(1993)4 ^ 9 B 

(51) Int. CI. ' 8$SiJfE-§- frrtSS*-^ FI 

H04N 13/00 8839-5C 



»aEB«* *IS* t»*iiroS:3 (^12M) 



(2i)aM#-§- 


4^11^3-278227 


(71) mmx 


000003078 










(22)aigiB 


^fi£3^(1991) 9^30B 




#i^;iip=;iiii@rif^E*a;iiBn2#ife 






(72)^B^# 


^ 0 §1 








#i^jiiiR;iiii(5m*E/M6i*:^iBTi 














(74) {^S A 


#a± ^« -m (^i-3iS) 



(54) imm<o^m ^i$:m^^mw±i^^TM. 



(57) [^1^] 




1 

w taiH*ff *iRi \z is »t 5 ffig ^m-r^n^mm t 20 
[if 2 J AngRswiif^m^o 1 o<o»* 

30 

ntcm^fd.mmw^mmvxti5mmmm^RxfW5^^n 

t(f^mrTiimin^-<Dmit^\cit^vxmmi&^i-:yyc^^ 40 
«i:fri£if::igft vxmmmm.m^mmT^&^ u vx$ij 

[000 1] 




i^W¥5-9 15 4 5 



2 

[0 0 0 2] 

mi&i-^:fymia±m^ ^^mi>mm^ttx\>^^iK mm 

i^»^^:AcoWBif:ztS^-f-?) 2 0(D;^|6];5^^>gJ^L, # 

[0 0 0 3] z<ommum:)j^xfi2:f3f^A^ib<Dm^i: 

^„ 0tJx.tf. /Must UTStt-t-Sii:?rtfI^t^tt^^$ 

bmsb (ommTd^im^w t *> * 9 e> ?i v ^^i 

[0 0 0 41 rwij'tc^A-^Ji. mmum^^(oii(o 

[0 0 0 5] 

[«W;55)»^LJ;5i:-t-5Sljai ±^<?3 J: 5 tc^S^WSc 

w^(omK^><^ (r>m^^WL^<Dm\zwi^-^f\,fc^¥Fbm 

Xft\i\ 

[0 0 0 6] J;oT. ;*:%0Jtt^MiIi«^^: briE^^tt 
lfe:fyj*StJ«St«J]ii«ieifegg*ti«i-i r t ^ B 6f) i: i- 

[000 7] 

fE»^Bt4. AfflPScoiS^ft-^-roioco*;*: 

m^^m^ L-xzn^um-r^iL^mw^mmsizm ^ 



SiK«iSr#-C, w4^S^l^^^«!l5pM<^JlfEIi^ffil|^T*f6]^c 

[0008] *5gBj0?3tf*cWlfeIEfii?f!£->;^7^A 10 

[ 0 O O 9 J 20 

[0 0 10] rcolSm. 3if*:ffi^(c»^$tb7tf><^T-(± 
5. 

[0 0 1 1 ] 

5Sr#fi8LTtttB^-rSo HIS (A) 14. S^^fc5 2o 
Sr^b-CV*?.. r<7)Sc:fri*:AS.t/BSr3ir^|!:^i LTJ^AK 50 




#M¥5-9 15 4 5 



4 

[0 0 12] *-r> ¥Siii«*»biiSfilSr?g^b-CV^5» 

mmiSLy~y^<ofH?^^m^xmmizmi:>tiz^^i^<r>m 

05 (B) {c^$ns = >'t:''aL-i?rtlrj^^$ti^c^« 
H^JCTuSratclEll-rSo iagi4^^^65S»<^*&$1575»P> 

ra{C{4SE:^i$:<D@«:M*AStI«B7JSiEg$n5. Mffico 

^y='/KDJ^^*« ts-f-T*— f:: J; oTHi^fSlSA^tl/B 

•f-SP-^ (x. y. z) co5*>v *;'cwx... 

<75 ij; C T Y - Z qz® (;c J; o T 'Sr^^S'Ji- 
S„ ll=ff;4?;*:^ittL(4^«iJ^^tii-<. 115 (B) r-l4 1 
, ~i, i7)3o<73^ffi{c:j;o-c^J#JL-cv^5« :i(o^ti 

ms (C) (7?S, I45pffil, 75^b#M;^(w§^tiiL.fe 
»w#*i-5@#:S*S:^bTV'>5o S, tt^^S 1 , i: I 

wirJwJ;!?, oiAp^u— AF,,~F,«Sr^§■5o roiiJn 
7U-AF,,~F,4irt4®^it#tr*D^-C, ©j^^tbS 
-i^^u-A^agSr^ip-r^w-Afitglwax, '~x 

1^— AF.B A^b@fls^^A^iTJ«B Srm>fcir 

AF,„. ■EeW^x« SrdI*DLT7U— AF,o 

^^Fti-S, rcDJ; ^JiPf^fe^QiSSrHe (B) <omm^<o 

^■7U-M.fj ~f ,tl^-o\,^TMl9)gx.■t-iEI6 (A) 

[0 0 13] '^^i^—j^^mty-r^^'f^m^-izi-iyu— 



( 4 ) 



#MqZ5-9 15 4 5 



[00 14] *^A»■52:«^M^fe^i■i■litr•7'3^•r'^;^^', 

[0015] m^\^fJ:\'^iLt^m^W^^W:\ziS\,^X}i. 

*{t-i-Sr«PbT#7-U-A«75iir^Srrn v?^. iJ' J; 
-pTSJ^LTPiffi<73^#M;^|S]lc:^lt)f-5-jS<Oili^Sr 

[0016] ;*:^lerol^iS0!l^roV^Tgl 1 RUm 2 Sr# 

K vxvLm-f-^o m 1 fi:^?&m<DiL»m^m^<7:>m^^ 

[0 0 17] t'T^'^f'^^^i!', fx:*-?'— 7", CD-R 

^^^ixxmiks^'ev 4izmm.^ix^. m^ti. —mm 

[0018] ^ y 4 17 u—j>,^(Dm^%:$i 
nm^mmsiz^^^, ^nm^mmstt. mm^r—f 30 

T. Bfifep«*y 4t::?^^SnTV>-5«f3?(*:co^{5r^6<);5: 

[0 0 19] '^)^^^i$i<om'^m'^^^^Hrz7'—9^ 

^li-T*— iJ'^— ;^^fiiJ^a8Sr:ft-UT±fH-7'-tJ"<— ;^ 50 



h » fcixfcff LV ^t'- 9 IIt'- 1? MM^e 7 J; 

[00 2 0] mn^mm^mm sizx ^m^f^m\i. m 
mi 3 <omm'^t^mz^i:'-^itmm^<omiEmMim:> 

;t fcii^^a^!!.S^cig ^' 3 >- — x-fe t) . ISiliffi H 

^lE^aE^* 1 1 (cfE^-rs. mm^(o 1 7 u— 

m7 u-j>.m^m^m^fE.mmi$^ 1 1 \z^m-r?> c: i: sr 

[002 1] /i*3. S^ff 1 3 

5o 

[O O 2 2 J Jifefr, ||^Tttg^t^gla5<7DlbmwOV^T 

ai Lfc J; 9 lw:ft=ffffig*t^§^g 5 (75^^35143 vf^— 
•J. BSi*-t-5^«(75*mSr'b=fT5r t*5-c?tr5, CPU 

y 4tc:H«1tSSrIEtg$ii: CxT^y^-s 10 3) , WT 

[0 0 2 3] *-r, Biffil^tc:S!)io/t^^?<*:(D?i^^^^^ 
-r-5X^ (;^7's/:7'S 1 0 4~S l l 3) , •S^^«:<o«% 

m-raie (p^T^s'T's io4~sio6) . mm^th 
rz.mwiS(Dmj^m^<o^'&^^Jikm^ws^xm± vt^mi^m 

SfibTJt^-t-SXS (^T^S'T'S 1 0 7~S 1 0 
-^^-r-SIg (^T^-yrT'S 1 0 9~S 110), '^zx^y 

v^sx 1 1) , rixtSfSr7'-^?-<-;^f;cs»-r5xa 
(;^7^s/:7'S 1 1 2~S 113) VN-Ttto? 

[0 0 2 4] *&fI5ttttiiiS (S 1 0 4) "Ctt, — fiajt L 
tt}L.fc!3, Z.i\,m(r>m'Ci)^h^v'J-k^m\^ {^"ryzf 

s 1 0 5) , 'i:(om^mmmm^^^mmmm\zx.o 

T*l?15Sr#J«)5 (:^7's/7'S 1 0 6) J; 5 Jfc^^PW^jfe 



1 0 0 2 5 1 f^^^mt^ (s 1 0 7) , mw^r'»:mvit 

*siS<, ^!£L#i^/^v^§6^)■^i (^xyT's i o 9) . 

10) , mMwm^n^-^—^^'^-'^y^/U'fi 
^f^:t-<l—S'Am^m^^z^■i (s 1 1 1) , ±se^- 

^A;^S5fel 0*?^fflV^2. (S 1 1 O) o ^T/55;gtSL 
fcby^-i5'-<-:^3SB6|;iSflS:-t-S (S 1 1 2) AK r 

<oi:#(7)x-^-<-;^M«ff^ll (;^7^5'7's 113) (± 
iJ' i S^f^li^ 1 l2H;iia« LfcBi^^^SB 5 a c^tiiB 
5, 

[0 0 2 6]i^V^T, CPUB:±fBHft:gm<^HffiF*JT- 

<7?WSfeeSr^^i--5Xg (;^7"-;/-7'S 1 2 1~S 1 3 

0) ^ms-tz. :Lti\-i.^witLm.m-^U5h-bmomm 20 

1) , mB-^m&'^&m^j:ifm.m^t<D§st>\)-c(r>mm 

5) , ^tri 5^^0:5/ :{'xm (^7^?'7°s 1 2 

7) . 'f-'$'^—:^^(Dm^J:m. (:^'T>yS 12 9) 

[0 0 2 7] *-r. j^m^h(Dmmmwt (s 1 2 d -e 

m^UilF-^rfti: 0 {^'Ty:fs 12 2), (s 
12 3) T'I4. 3tt)OKAt-^»a4^« -i^wa!? B.-g-tC 
^■r-5*P^y^— ^-s:— ;^ (;^7"y7°S 1 2 4) ^ffiV^ 

2 6) -eixt^^T-fc-Sc ^{r ±5 

s'T's 12 7) 5tl:::i$'<fcrt#^l^^<z>XS*SKfe 
tt5 (^7" 2/ 7*5 12 8. S 1 3 0) , 
[0 0 2 8] ±fa«iST'*a6fc=g-@^^?S<7)M^ 

rawsr^jt-fk-rsxa c^t^s/t's 1 3 i~s 1 4 

1) , ^ig'+fet/i^HJ^cottttSXe (^^T^yT'S 1 3 

2) . ]Sjff5*<7??f:fe;^i:(Otttt5XS (;=?.7"5/:7'S 1 3 

4) , >t-^l^-^felcJ;58«M^<73«ttSXS {Ts^vrf 
s 1 3 6) St/iLix^ro^aii/^' . M^Xig (7.7-y-:f 
S138, S14 0) SrUff-rs. ;^7'2/:7's 1 3 1 ~ 

s 1 4 1 (4ik^*:^a«^^l^s« 5 b 5tewts«e<o— gu 50 




i|#W¥5-9 15 4 5 
8 



[00291 f€t-*»'fW^jSI*Sj|^TbTV>:54&^ (S 1 
3 1) 14. • Sfi!:^^l8St;«$feiSL:fc<^i:|^«:fc 

m^<^#^f^|| C^T^Sz-T^S 1 3 9. S141)SrS 
X^(n>^m\z.W<i-r^. ^5T-/j:v^»-&(4 (S 1 3 

1) . @^|i:^5S<OT^^fe^*fct^sr^ToTv^3^v^^: (si3 

2) . mz.^m.^^x\^^WiW^mh%m7'-9^-:^ 

A. -iMm^o^) ^mm-t^ (^T^s/rs 1 3 3) . 

?8^^05flSm;4StTl5n-CV^:fcV^ (S 1 3 4) i:, fE 

xyT's 1 3 5) . ^i^^Jc:j:S;tfi'fk«stTip*v 
TV^Tiv^ir (S 1 3 6) , i^o#t;t:l.-g-^fero*)-fr*-^ 

(;^7^2/7'S 1 3 7) . £X±(OT.mzt3\,^Xm&1^^<D 
m-^mA^m^t^ (S 1 3 8) . Ji|E^-^A;^jSS3^^ 
mi 0^r'-i^-<-:^mimm8^ii-LX:t^u~^Ai 

y'—^(omm^mm.y'~-^<oxt]^n':>xiiS:\>^ (si 

3 9) , 

[0 0 3 01 mc. ^mw^miz-^-^H^mimmo^tfs 
mmm^-^m^t-t^nm (:^T-y^s i 5 i~s 1 5 

±ifumm. mi^wm(r>m\!h\zM-r^ii<DAi-^^X'h 

134) T% i!E^^:^^^)Tfc■50-er:rT•l±^Tpi^^>^^)5/i 
V\ rwXS (S 1 5 1~S 1 5 9) ttfflSmeitS^gB 

[003 11 cn*f3*-<7tXgJ4— ocoiIjDSI;:o^^T 

1) Mfrf&<7?®ffi^ili^p<^y 4t'iq2UfJ±5bT. 
fc5v^(4S(^p<^>; 4^;lte<oii^ffi^>fSti$i^-cv^5 1$ 

16 2) . -f-t^^^iSfFlHl^mirSrJttfiii-Sr i:{-J: 
K>. itSf^*<?3ii-&aSrr6]±$Hi-'5 (S 1 6 3) e 
f-t^feirlH^ro^ais/^ . IS^-f^^ (;=<.xy7'S 1 6 4 
~S 1 6 7) 

[0 0 3 2] ii(±rox^Sr;S^T Ufc^. H^tC'fiSffl-f-.S 

H^ff^^Bi 3<^*^T^^•^??^gsu•ii^ffi<^*^f^e:^-^v^ 

T^triliffi (ilAD^u— A) (DtSc^ir^triUSw^iBS: 
^««>?> (;^7"s'7's 1 7 1) o :i<o||fTBfffiwtft:^jatJf 
ffifi»c:/^:;CT?^f/J;-t-5@#:S* • ISlJ^M^SrEIS (C) 

LTIr)— SggiBH^ttfcBfH^^g 9 ± o Tig^ /iB^iE 

2) o A^;Io^^T:^7"s/:rs 1 o 3~ 



s 1 7 2 •? 31 vxmiSLmmmi^ 1 1 izw-mm^y- 

fens, r(Oltfls:®|fey-;^»c:f4, #7 w-AgjcHtr 
I 0 0 3 3 1 ^ L-C. iZ:ft:H^O^fiS:{CfcoTlilB^iE 

iiiffiSrj^j^L, ft^^ffi«*J^»m■§-K>||^T^1^«^rJ;oTi® 

[0035] EI 7 Ji. ±3* L-fdM^li^iSS 1 3<Do 

[0 0 3 6] m^^mm^mmmm i 2 ir j;o-c«is$ 

n/c tf x^ft^ti, iiiiaW^ISfg 1 3 wH^tf iE^ 1 3 
a »::SI?>ix5, @ffli^*jESB 1 3 a tt. hr•7'3^m■§•S:ll^ 

1 4 a .• 14b »J:!9;fe-e# 5. "IWjuvXSiJ^SfB i 3 

di4gi^{4SS)j»m^i-^^v^TPiW)u-vxigsi 3 c 

4<D^S*55iff:frfBi<^?Str«»r^tiii-s. 'fc^j. tr 

T«^$^xT#t#^$tv?)^{c:ttm-^^«l^l 3 i [rj; 40 

[0 0 3 7] ^f^\zf$.tL-r^n^<Dm'^<r>}iT:fj^(r)fgL 
m-tmikWiE^ 13a -^Jifa^s!) ui^xgc i 3 c -ciisi 

3 1 3 gSrfflV^-Ciil^C0^5i:^BS:^MT?^5o R 

^mi 3eRu^i3 sii^^^^mm^^immmi 3 f 

StKl 3 hJ^ioTl^roSAt^^Ttt) 2i*«Wtilf^ 
[00 3 8] m^SLW^mS 1 3 75»t><DlS:i^4R(±li|ft3t«6 50 



(6) ^M2qt5-9i54 5 

10 

1 5(r©o-C^S:L-. Gflffi^l 7^SSL-C«^#1 6 
17a. 17b S:3Sbfc/c»tO?g^8T"b, DflffiiiEW^^ffi 

18a. isbirfst. PflE«£r-?i^AS;$nsg:w^(± 

14a. 14b t^iio 

[00 3 9] *M-C-ii±ISiii^*« 1 5 iDflffi^ro^ttt 

ei 3rt<D#giJttiiiE/i:i^«{cwK;«$n5, 
[0 0 4 0] ±ie<D®{ty^y IC— ^|E»$n 

}t<i:2la<^J:5 1 , felt gfttfc -SW^ 

b-cs^^nso mx'iiWLm<omm(orzif3. m^^nti. 

■t-5ig5«5l75SS>5d5. ^i^Mffiwi^-rX;4S:fe#</£5i:, 
H^<oif-^' Xt 2 1 b J: 9 JcA^ <ti'9. f^m^iz:^ 

^^mm-f-'i X>jS 2 1 c <0 ± 9 ^ < 

fl* ^ n/ci5i:#:ilf^{e:fi^ C 5 ■5Ttg1<fe;J5 ^ /c . 
±fS®^^^gB5 a t±t&&mm^U5 hX'm^MM<D 

^i^m^t:m^vtc^. ±ts.msmmm^us cxmiE 
[004 1] &L±vim vtcf*im\i^mm\z^^mmi<o— 

ii^coSfi<)S:^^-t-5^<?3flfe<?3^*a<73^jSo^A^. a 
[0 0 4 2] 




( 7 ) 



11 



Hlo 

10 21 3i:<*:®^S^^Sr^-r:^n 2/^121, 

[1131 m^f&m^m^Tjk-f^a—^^—h, 

1061 a^®^m#srift?^-r50o 10 




12 

1,11 H^IH^SE^*: 

9 m-^^mi&mm^mmm. 

1 2 iif^l5fli^«<*SII|^« 

1 3 mmm^mmi 



[021 [g|5] 




(C) 



Fii.xi 



( 8 ) 




#M^5- 9 15 4 5 



[1^1] 




CTr 



LO 





C\J 



CO 



m 





15 4 5 



5103 
"5/04 



•S/05 



SJ/0 



SI2I 



'SII3 



I — 



SI22 



S/28 



(10) #M¥5-9 15 4.5 



141 



^5134 



SI56 



□ — ^ 



"^5133 



■^5135 



1 



^S/53 



□r 



^5155 



^SJ57 



'S159 




'5 ~5;7/ 



>SI72 




^mW^5-9 154 5 



21a 



ims] 



